What Is Claimed Is: 



1 1 . A method of motion estimation and compensation processing, comprising: 

2 determining a preliminary motion vector from a set of partial motion 

3 vectors each associated with a corresponding subsampled 

4 matchblock representing a given picture; 

5 generating a second motion vector based on a refined granularity of the 

6 preliminary motion vector; and 

7 performing a fractional pixel search using the second motion vector to 

8 produce a final motion vector, the final motion vector being used 

9 for motion compensation. 

/ 2. The method of motion estimation and compensation processing according to 

2 Claim 1, wherein determining a preliminary motion vector, comprises: 

3 dividing the matchblock associated with the given picture into a plurality 

4 of first sub-blocks; 

5 dividing a search area associated with a reference picture into a plurality 

6 of second sub-blocks, the second sub-blocks being divided by a 

7 factor similar to that used to divide the first sub-blocks; 
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8 duplicating one of the first sub-blocks over each of the second sub-blocks; 

9 and 

10 determining a set of best matches between a respective sub-image in each 

u of the first sub-blocks and a sub-image in each corresponding one 

12 of the second sub-blocks, the set of best matches representing the 

13 set of partial motion vectors. 

/ 3. The method of motion estimation and compensation processing according to 

2 Claim 2, wherein the first sub-blocks each comprises a Q x Q array of pixels subsampled 

3 from the matchblock, and the second sub-blocks each comprises an M x M array of 

4 pixels. 

1 4. The method of motion estimation and compensation processing according to 

2 Claim 3, wherein M = 1 6 and Q = 4. 

1 5. The method of motion estimation and compensation processing according to 

2 Claim 3, wherein Q = 19 for bidirectionally predicted coded (P-type) pictures that are in 

3 sequence previous to and subsequent to the reference picture. 

/ 6. The method of motion estimation and compensation processing according to 

2 Claim 3, wherein Q = 19 for left and right portions of the given picture, when in a 

3 predicted coded (P-type) format. 

1 7. The method of motion estimation and compensation processing according to 

2 Claim 2 ? wherein determining a set of best matches comprises: 
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3 performing exhaustive searches in parallel for each of the first sub-blocks 

4 over each respect one of the second sub-blocks. 

1 8. The method of motion estimation and compensation processing according to 

2 Claim 7, wherein performing exhaustive searches in parallel comprises: 

3 calculating a partial sum of absolute distance (Psad) between coordinate 

4 positions of one first sub-block and a corresponding one of the 

5 second sub-blocks. 

1 9. The method of motion estimation and compensation processing according to 

2 Claim 8, wherein the Psad is determined from 

3 Psadij= 2 | match i d --refij |, 

4 ij = o.J 

5 wherein i represents an x coordinate position, j represents a y coordinate position, matchi j 

6 represents a first sub-block, and refg represents a second sub-block. 

1 1 0. The method of motion estimation and compensation processing according to 

2 Claim 7, wherein performing exhaustive searches in parallel comprises: 

3 contemporaneously moving each of the second sub-blocks relative to each 

4 corresponding first sub-block to a next location; and 

5 calculating a partial sum of absolute distance (Psad) between coordinate 

6 positions of one first sub-block and a corresponding one of the 

7 second sub-blocks. 

1 11. The method of motion estimation and compensation processing according to 
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Claim 1, wherein generating a second motion vector based on a refined granularity of the 
preliminary motion vector, comprises: 

obtaining the matchblock associated with the given picture; 

enlarging a first search area to generate a second search area, the first 

search area being associated with a reference picture and used to 
determine the set of partial motion vectors; and 

determining a best match between a respective sub-image located in the 
matchblock and a sub-image that is identical to the respective sub- 
image and that is located in the second search area, the best match 
representing the second motion vector. 

12. The method of motion estimation and compensation processing according to 
Claim 11, wherein determining a best match comprises: 

performing an exhaustive search for the respective sub-image over the 
second search area. 

13. The method of motion estimation and compensation processing according to 
Claim 12, wherein performing an exhaustive search, comprises: 

calculating a partial sum of absolute distance (Psad) between a coordinate 
position associated with the matchblock and a corresponding 
coordinate position associated with the second search area. 

14. The method of motion estimation and compensation processing according to 
Claim 13, wherein the Psad is determined from 
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3 Psadij = S | match \ j - ref i j | , 

4 ij-O.J 

5 wherein i represents an x coordinate position, j represents a y coordinate position, matchy 

6 represents the matchblock, and ref \ j represents the second search area. 

1 15. The method of motion estimation and compensation processing according to 

2 Claim 13, wherein performing an exhaustive search, comprises: 

3 for each coordinate position associated with the matchblock, calculating a 

4 partial sum of absolute distance (Psad) between each said 

5 coordinate position and all coordinate positions associated with the 

6 second search area. 

/ 16. The method of motion estimation and compensation processing according to 

2 Claim 11, wherein the matchblock comprises an M x M array of pixels, the first search 

3 area comprises a Q x Q array of pixels, and the second search area comprises an Q+2 x 

4 Q+2 array of pixels, where Q a MIA. 

1 17. The method of motion estimation and compensation processing according to 

2 Claim 16, wherein M = 16 and Q = 4. 

/ 18. The method of motion estimation and compensation processing according to 

2 Claim 1, wherein performing a fractional pixel search using the second motion vector to 

3 produce a final motion vector, comprises: 

4 obtaining the matchblock associated with the given picture; 

5 enlarging a first search area to generate a second search area, the first 
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6 search area being associated with a reference picture and used to 

7 determine the second motion vector; 

8 determining a half-pixel predicted reference macroblock associated with 

9 the second search area; and 

10 determining a best match between a respective sub-image located in the 

11 matchblock and a sub-image that is identical to the respective sub- 

12 image and that is located in the second search area, the best match 

13 representing the second motion vector. 

/ 19. The method of motion estimation and compensation processing according to 

2 Claim 18, wherein determining a best match comprises: 

3 performing an exhaustive search for the respective sub-image over the 

4 second search area. 

/ 20. The method of motion estimation and compensation processing according to 

2 Claim 19, wherein performing an exhaustive search, comprises: 

3 calculating a partial sum of absolute distance (Psad) between a coordinate 

4 position associated with the macroblock and a corresponding 

5 coordinate position associated with the second search area. 

1 21 . The method of motion estimation and compensation processing according to 

2 Claim 20, wherein the Psad is determined from 

3 Psadi j = S | match y - ref y | , 

4 ij = 0.3 
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5 wherein i represents an x coordinate position, j represents a y coordinate position, matchi j 

6 represents the matchblock, and ref j j represents the second search area. 



1 22. The method of motion estimation and compensation processing according to 

2 Claim 19, wherein performing an exhaustive search, comprises: 

3 for each coordinate position associated with the macroblock, calculating a 

4 partial sum of absolute distance (Psad) between each said 

5 coordinate position and all coordinate positions associated with the 

6 second search area. 

i 23. The method of motion estimation and compensation processing according to 



2 Claim 18, wherein the matchblock comprises a 16 x 16 array of pixels, the first search 

3 area comprises a 4 x 4 array of pixels, and the second search area comprises a 18 x 18 

4 array of pixels. 



/ 24. The method of motion estimation and compensation processing according to 

2 Claim 1 , further comprising: 

3 determining residual data associated with the final motion vector; and 

4 reconstructing a video signal for encoding based on the residual data and 

5 the final motion vector. 

/ 25. The method of motion estimation and compensation processing according to 

2 Claim 24, wherein determining residual data (residue^) associated with the final motion 

3 vector, comprises: 
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4 determining match data (matchy) for Y, U, and V components of the given 

5 picture; and 

6 calculating prediction data (predi j) of a reference macroblock (refi j) 

7 associated with a half pixel search. 

I 26. The method of motion estimation and compensation processing according to 



2 Claim 25, wherein the predy is determined according to 

predi j = 

(refy + refill + 1) » 1; or 
(refij + ref i)j+ i + 1)»1; or 
(refy + re^ lj +l)»l;or 
(refij + refi+i j + 1) » 1; or 
(refij + re%i + ref l4 j + ref M j_! + 2) » 2; or 
(ref,j + refij.! + ref i+1 j + ref i+ i d _i + 2) » 2; or 
(refij + refy+i + refj+i j + refi+i j-h + 2) » 2; or 
(refij + refi j+i + refU j + ref M d -+i + 2) » 2, 

wherein i represents an x coordinate position and j represents a y coordinate 
position of the reference macroblock. 

27. The method of motion estimation and compensation processing according to 
Claim 26, wherein the residual data is determined by 
residuei i = match i \ - pred i ; 

i0 = 0..15 ' J 



1 28. The method of motion estimation and compensation processing according to 

2 Claim 27, wherein reconstructing a video signal for encoding based on the residual data 

3 and the final motion vector, comprises reconstructing the macroblock data according to 

4 reconstructed j = residue ^ - pred i j . 
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5 *-°" 15 

/ 29. The method of motion estimation and compensation processing according to 

2 Claim 27, wherein reconstructing a video signal for encoding based on the residual data 

3 and the final motion vector, comprises performing decompensation to reconstruct the 

4 macroblock data based on the residue data and the prediction data. 

1 30. A computer-implemented method of motion estimation processing, 

2 comprising: 

3 dividing a matchblock of a current frame into a plurality of sub- 

4 matchblocks, the current frame to be encoded; 

5 dividing a first search area of a reference frame into a plurality of search 

6 sub-blocks; 

7 replicating a sub-matchblock over each of the search sub-blocks; 

8 performing partial pixel level searching in parallel of each sub-matchblock 

9 replicated over the search sub-blocks to generate a preliminary 
w motion vector; 

u modifying the first search area to produce a second search area; 

12 performing full pixel level searching of the matchblock over the second 

13 search area to generate a second motion vector, the second motion 

14 vector being of finer granularity than the preliminary motion 

15 vector; and 

16 performing half pixel searching on the second motion vector to produce a 
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17 final motion vector used for motion compensation. 

/ 31. The computer-implemented method of motion estimation processing 

2 according to Claim 30, further comprising: 

3 determining residual data and prediction data associated with the final 

4 motion vector; and 

5 reconstructing a video signal for encoding based on the residual data and 

6 the prediction data. 

1 32. A video compression system, comprising: 

2 a processor-based platform coupled to a bus subsystem; and 

3 coupled to bus subsystem, a front end subsystem having at least a motion 

4 estimation and compensation (MEC) engine coupled to a stream 

5 buffer. 

1 33. The video compression system according to Claim 32, wherein the MEC 

2 engine includes: 

3 an A x B array formed from a plurality of cells coupled to a set of 

4 controllers and an end column processor. 

7 34. The video compression system according to Claim 33, wherein the A x B 

2 array includes: 

3 a M x N sub-array of p__cells; and 

4 coupled to the p_cells, a plurality of boundary cells bounding the M x N 
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sub-array. 

35. The video compression system according to Claim 34, wherein the boundary 
cells include: 

a plurality of updown cells disposed along a first set of opposing sides of 
the M x N sub-array of p_cells; 

a plurality of io cells facing a plurality of column cells, the io cells 

disposed along one side of a second set of opposing sides of the M 
x N sub-array of p_cells, and the column cells disposed along the 
other side of the second set of opposing sides of the M x N sub- 
array of p_cells; and 

a plurality of corner cells coupled to the updown cells. 

36. The video compression system according to Claim 35, wherein N = 5, and M 
= 20,A = 7, andB = 22. 

37. The video compression system according to Claim 33, wherein the set of 
controllers includes an x-controller and a y-controller each having respective control lines 
coupled to the MEC array to form an MIMD arrangement. 

38. The video compression system according to Claim 33, wherein the end 
column processor receives output signals from the MEC array. 

39. The video compression system according to Claim 32, wherein said system is 
included in one of a PC camera, digital camera, personal digital assistant (PDA), 
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3 multimedia cellular mobile phone, digital video recorder (DVR), and multimedia device 

4 and appliance. 

1 40. The video compression system according to Claim 32, wherein said system is 

2 included in one of an SoC and an ASIC applications. 

1 41 . A computer program product for motion estimation and compensation, the 

2 computer program product stored on a computer readable medium, and adapted to 

3 perform operations of: 

4 determining a preliminary motion vector from a set of partial motion 

5 vectors each associated with a corresponding subsampled 

6 matchblock representing a given picture; 

7 generating a second motion vector based on a refined granularity of the 

8 preliminary motion vector; and 

9 performing a fractional pixel search using the second motion vector to 
10 produce a final motion vector, the final motion vector being used 
/ / for motion compensation. 

1 42. A computer program product for video compression processing, the computer 

2 program product stored on a computer readable medium, and adapted to perform 

3 operations of: 

4 dividing a matchblock of a current frame into a plurality of sub- 

5 matchblocks, the current frame to be encoded; 

6 dividing a first search area of a reference frame into a plurality of search 
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sub-blocks; 

replicating a sub-matchblock over each of the search sub-blocks; 
performing partial pixel level searching in parallel of the sub-matchblocks 

replicated over the search sub-blocks to generate a preliminary 

motion vector; 

modifying the first search area to produce a second search area; 

performing full pixel level searching of the matchblock over the second 
search area to generate a second motion vector, the second motion 
vector being of finer granularity than the preliminary motion 
vector; and 

performing half pixel searching on the second motion vector to produce a 
final motion vector used for motion compensation. 

A video processing system providing motion compensation, comprising: 
means for determining a preliminary motion vector from a set of partial 

motion vectors each associated with a corresponding subsampled 

matchblock representing a given picture; 
coupled to the means for determining, means for generating a second 

motion vector based on a refined granularity of the preliminary 

motion vector; and 
coupled to the means for generating, means for performing a fractional 

pixel search using the second motion vector to produce a final 

motion vector, the final motion vector being used for motion 
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ii compensation. 

1 44. The video processing system according to Claim 43 , wherein the means for 

2 determining a preliminary motion vector, comprises: 

3 means for dividing the matchblock associated with the given picture into a 

4 plurality of first sub-blocks; 

5 means for dividing a search area associated with a reference picture into a 

6 plurality of second sub-blocks, the second sub-blocks being 

7 divided by a factor similar to that used to divide the first sub- 

8 blocks; 

9 means for duplicating one of the first sub-blocks over each of the second 

10 sub-blocks; and 

11 means for determining a set of best matches between a respective sub- 

12 image in each of the first sub-blocks and a sub-image in each 

13 corresponding one of the second sub-blocks, the set of best 

14 matches representing the set of partial motion vectors. 

1 45. The video processing system according to Claim 43, wherein the means for 

2 generating a second motion vector based on a refined granularity of the preliminary 

3 motion vector, comprises: 

4 means for obtaining the matchblock associated with the given picture; 

5 means for enlarging a first search area to generate a second search area, 

6 the first search area being associated with a reference picture and 
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7 used to determine the set of partial motion vectors; and 

8 means for determining a best match between a respective sub-image 

9 located in the matchblock and a sub-image that is identical to the 
w respective sub-image and that is located in the second search area, 
// the best match representing the second motion vector. 

/ 46. The video processing system according to Claim 43, wherein the means for 

2 performing a fractional pixel search using the second motion vector to produce a final 

3 motion vector, comprises: 

4 means for obtaining the matchblock associated with the given picture; 

5 means for enlarging a first search area to generate a second search area, 

6 the first search area being associated with a reference picture and 

7 used to determine the second motion vector; 

8 means for determining a half-pixel predicted reference macroblock 

9 associated with the second search area; and 

10 means for determining a best match between a respective sub-image 

located in the matchblock and a sub-image that is identical to the 

n respective sub-image and that is located in the second search area, 

73 the best match representing the second motion vector. 

1 47. A video processing system capable of providing motion compensation, 

2 comprising: 

3 array means for processing data received from memory means to 
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determine a motion vector; 
coupled to the array means, means for selectively controlling the array 

means to enable processing of the data received; and 
coupled to the array means, end column means for obtaining the motion 

vector from the array means to enable motion compensation. 



64 



22682/061 88/DOCS/l 1 9407 1 . 1 



